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SYMBOLS AND ARTIFACTS 


There's a delicate tension between showing and telling. A good teacher or 
speechgiver works with concrete images; Ronald Reagan is a prime example. 
People forget statistics and trends, but they grasp the meaning and keep the 
memory of anecdotes -- even if they abhor them as cheap tricks, unrepresen- 
tative of a broader reality. It’s the same with software -- programming 
with instructions vs. all the handy tricks we've developed for end-users: 
query by example, script recording to generate macros, point-and-click and 
icons. All these are methods for making the system more immediate and ac- 
cessible to the user. They make him feel his work and data are right there 
on the screen, at his fingertips, rather than waiting to be assembled from a 
mass of ones and zeros on a silicon or magnetic platter. 


But there comes a time when immediacy is too much. In large-scale democra- 
cies, we have representatives rather than referenda to handle most issues. 
In business, we follow rules rather than check with the boss each time some- 
thing happens. With databases, we have moved from record-by-record process- 

pie ing to set-based processing. We subscribe to newsletters (don’t we?) rather 

(i } than buy them issue by issue. And we program rather than manipulate data 

` piece by piece. The question is how to meld the power of programming with 
the immediacy, intelligibility and picture-worth-a-thousand-words quality of 
direct manipulation. This issue assesses four attempts at such fusion. 


To use one more anecdote by way of illustration (a cheap trick, no?), con- 
sider the story of the spreadsheet. Before the dawn of history, programmers 
could build (or executives could order) financial models using programming 
languages or financial planning languages. But few people bothered to. 


Then Dan Bricklin came up with the right picture, the one worth a thousand 
words of code. Suddenly people were creating spreadsheets all over the 
place. It was not the output or the computer capabilities that had changed, 
but the process, which was now acces- 
sible to normal people. The next step 
was macros. Smart or experienced people 
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adds a row or two.) Named ranges help a bit, but they’re ultimately depen- 

dent on local phenomena rather than any kind of global meaning. Enter Lotus Ek 
Improv (or for that matter, ManageWare’s Compete or Javelin; see Release 1.0, 
85-6). Now users can deal with global variables and labels that mean some- 

thing to the computer as well as to the user. They can manipulate revenues 

of a particular product line, summarize or go for detail, change overall as- 

sumptions, without losing that touch-it-with-your-hands feeling. They can 

both see their data globally, and feel it locally. 


The rest of this issue is about several approaches to such a desirable fusion 
in a variety of areas. The first, virtual reality, is wholesale direct man- 
ipulation and user experience. It has great utility for design, etc., but 
will offer even greater power and gain a new range of users with the advent 
of user programming capabilities. This issue discusses VR in general, and | 
notes VPL Research's first steps towards a user programming language. , 


The other three: Calypso from Systems in Concert lets you visualize and 
manipulate flows of work from person to person -- and then generates the code 
to make it happen. AllClear from Clear Software works the other way: A user 
describes in his own words, plus a little required syntax, the procedures to 
follow, and the system generates a flow chart so he can see the forest he has 
described tree by tree. And then there's DB Software's RE/ generator, aimed 
mostly at professional database designers. Using statistical and sampling 
techniques, it allows designers to "feel" and see the data as they design 
structures to accommodate it. Rather than summarize numbers with averages 
and totals, it picks out the relationships among fields and tables so that 
designers needn’t deal totally with abstractions. 


The trick in all these systems is to find those tenuous links between the ee. 
general structure and the particular instances, and to ease the user’s way in 

moving between them. What’s the dichotomy? We don’t know quite how to tell 

you (the rules aren't clear), so we'll show you these examples just for fun: 


Tell Show Tell Show 

model example instruction demonstration 
outline text explain describe 

vector raster signal sign 

symbol artifact message mail 

rule actions couple Juan & Alice 

draw paint flowchart lines of code 
panel speeches speech comments 

database data value price 

workflow tasks forest trees 

sequence list graphics object FatBits 

picture pixels argument statements 
understand know know feel 
advertisement announcement story line events 

symbols words word character string 
education classes goals plans 

market buyers & sellers class instance 

alive brain-dead racing running 

genius idiot savant function form 

architecture construction model formulas 

object data element whole parts ay 
genes person person body parts oy 
equation variables system units 

Release 1.0 8 October 1990 


VIRTUAL REALITY: SPREADSHEETS FOR INDUSTRY 


Popular notions of virtual reality are contrary to its reality. To cyber- 
punks, it’s a new medium, the next best thing since mind-altering drugs. 
Mass-market magazines would have you believe it’s a hot new consumer craze. 
In fact, it’s the application of a set of high-end technologies for interac- 
tive 3D modeling and simulation, combined with input mechanisms that can 
sense users’ gestures and movements. Virtual reality has immediate useful 
applications for a relatively small cadre of designers, manufacturers and 
other people. For them, it’s a powerful design tool, one to catch up with 
the Joneses in the front office with their spreadsheets and executive infor- 
mation systems. With a get-started cost approaching $100,000 for serious 
work and a paucity of software to work with, it will start at the high end 
first. lLong-run, companies such as Autodesk will bring VR (as they brought 
CAD) to a broader engineering market, while Nintendo and its ilk bring 
cheaper, less complete implementations to the consumer: market. 


Thus, like most significant technologies, virtual reality has two faces. 
There’s the practical, business-minded technology/tool for designers, engi- 
neers, doctors, pilots in training and marketers (among others). Who needs 
clay models, training cadavers, press tours and airlines when you have vir- 
tual reality? And there’s its medium-of-the future face, with visions of 
eyberpunk, enhanced communication, virtual-reality identities and a host of 
social implications. Virtual reality is a publishing medium for direct ex- 
periences. Who needs Bali when you have virtual reality? 


The first market is more immediate and more immediately useful. Some of the 
hype is misleading; for example, "For once, reality has competition." In 
fact, before electronics there were books, lies, movies and dreams. Now, 
reality has one more variety of competition. And yes, it will undoubtedly 
change the way we think about things. Clocks have made us think different- 
ly, as have automobiles (see "The Culture of Time and Space: 1880-1918," by 
Stephen Kern, Harvard University Press, 1983). The real impact of virtual 
reality in the long run will be no less profound, on our assumptions as well 
as our technical capabilities. In this issue we discuss first the immediate 
business implications, and then wander off into more speculative realms -- 
specifically, both the values and shortcomings of virtual reality’s ability 
to offer direct “experience" and its lack of symbolic content. Can it -- 
should it? -- stay all show and no tell? 


Virtual reality, or virtual experience? 


But first of all, let's examine what virtual reality is. The term obscures 
rather than provokes clear thinking. Virtual reality is about as broad a 
concept as artificial intelligence, and comes in as wide a range of imple- 
mentations. In the most popular form, rather than look at a screen, you put 
on headgear and gloves to be immersed in a computer-created 3D simulation of 
reality -- or in a model that exists only in a designer's mind. You sit 
"inside" the screen (actually, behind displays in front of each eye), so 
that the computer simulation surrounds you. But depending on whose market- 
ing you hear, VR or a broader term, artificial reality, can also mean using 
holograms for models and cameras to pick up user movements without the en- 
cumbrance of special clothing. In the end, these are implementation de- 
tails, although they dramatically affect the quality of the experience. For 
now, most commercial systems involve clothing and goggles. 
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The mechanics 


Two kinds of transducers (behavior and sensory) convert data from the model 
world to the user's world and back again. The system picks up the user's 
behavior -- gestures, movements of the head or body, possibly voice commands 
-- and translates it for the virtual world. Software running on a powerful 
real-time computer computes changes in the model in response to the user's 
movements and gestures. The model world contains objects that have pro- 
grammed behavior; they react to each other, to programmed "forces" such as 
gravity, and to the user's movements. This behavior generates changes in 
the images, sounds and other sensory signals the system sends back to the 
user. The changes can be simple movement of the entire scene, with perspec- 
tive changing appropriately, or rotation or movement or other behavior by 
individual objects that the user "touches." All this involves enormous 
amounts of computation as light angles, surfaces, and other factors must be 
recomputed in real-time. Rendering (textures and other realism) adds to the 
computational load, and is pretty crude so far. 


The people who study what you are actually able to perceive 
through each of your sense organs discover extraordinary limit- 
ations. Yet you have the sensation of perceiving a whole lot 
in a continuous way. In virtual reality we put "clothing" over 
the sense organs and replace the sensory perceptions that nor- 
mally come from physical objects with ones from simulated ob- 
jects. Once you reach a certain threshold where your nervous 
system treats the synthetic objects as "reality," all of a sud- 
den your body and mind do all the work and make it look good. 
The human body is our secret ally; it lets us get away with 
weak technology. The best we can do right now is still very, 
very simple compared to what we want. 

-- Jaron Lanier 


Underlying all this is the idea that the computer can send signals to our 
senses to replace those sent by real objects. The interface never was the 
screen; it was in our heads all along. In other words, we don’t really 
"see" reality; we receive light waves on our retinas, sound waves in our 
ears, and nerve impulses relayed from our skin and muscles, chemicals in our 
noses and mouths, and interpret those as "reality." Some of those signals 
-- basically, sound waves and light waves -- can be created by computers, 
and give us the same sensations that "natural" signals do. Computer engi- 
neers work meticulously to create mock-ups of actuality to send precisely 
the right signals. These mock-ups are more than just images on a screen; 
they're three-dimensional models whose images get computed in real-time as 
they operate according to their programmed behavior and as you "move" them 
or yourself by turning your head or moving your hand or body. Usually the 
models are a set of engineering descriptions plus programmed behavior; the 
computer power is necessary to transform that into the proper light signals 
for any given simulated location and angle the user might assume. 


The effects are startling: You can sit inside a fictitious car to see whe- 
ther the dashboard is at the proper height, fly over or through fields of 
complicated piping with leaks shown in red, or do repair work remotely while 
a robot does the real repairs in some dangerous or inaccessible location. 
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You can go beyond simulations of "reality" to other effects...call them vir- 
tuality. In short, as with other capabilities, first we use them to mimic a 
familiar technology (Chorseless carriage, wireless radio, “screenplays") and 
then eventually we discover what they can do uniquely well. What makes VR 
exciting is precisely that it’s different from reality -- much as artificial 
intelligence is different from intelligence. VR lets you go beyond reality 
and fool around with dimensions and perception. You can watch something 


happen very slowly that normally happens quickly, or vice versa -- a car 
crash, for example, or the growth of a tumor. You can watch things big or 
small -- for example, the reaction of two molecules or the construction of a 


building. You can perceive things you couldn’t normally perceive, with X- 
ray vision to look inside a patient's body, say, or infrared vision to see 
heat leaks in a power plant. Finally, you can go back back from virtual to 
real, and manipulate tools remotely in other wise inaccessible spaces. 


Virtual reality offers four basic effects, although you could define others, 
and many applications involve combinations of these capabilities: 


(1) simulation of reality, so you can experience something before it’s 
fixed in tangible implementation, possibly vastly smaller or larger, 
faster or slower or more distant than reality (you can fit protein 
molecules together to make designer drugs, or design and test things 
-- buildings, cars, hydraulic piping -- without worrying about dimen- 
sions or the dangers of poking around inside a nuclear plant); 

(2) signal conversion, so you can experience something real but not nor- 
mally detectable by your senses, as in leak detection (invisible chem- 
icals made visible, so that carbon monoxide looks like a dirty cloud), 
or for stress analysis (the wing looks red where the joints are 
straining) or seismic analysis, so you can "move" through virtual 
solid earth looking for oil or (computer-generated) glows that show 
the presence of seismic tensions that could lead to earthquakes; 

(3) remote manipulation (or telerobotics or telepresence), where you can 

manipulate virtual objects that in turn manipulate the real thing -- a 

| microscopic medical instrument, a space ship docking mechanism, an un- 
dersea robot, or a tool in a radioactive area -- while you're sitting 
safely on the ground in human scale; and 

(4) annotation, where you can "label" reality, so as to highlight the 
organs for a medical student, or a broken widget for a repair person. 


The process is the medium 


What makes this better than just watching a simulation on a screen? For 
one, you're inside the world, with the ability to turn around in 3D as the 
world recomputes itself around you. Second, you have the ability to go in 
and manipulate it -- directly, by moving your hand, grasping objects or 
manipulating virtual tools. There are routine tools for painting, cutting 
and so forth, but also tools for copying (try that in the real world, with 
coins for example), shrinking or enlarging, stretching or otherwise “edit- 
ing" the virtual world. Sure, you could probably do some of this with a 
mouse, but the difference in feel is akin to what the mouse did for design- 
ers when it replaced the keyboard. 


Practical applications abound, as listed above, in design and modeling, and 
Poa in reaching large, small, inaccessible or dangerous environments such as hu- 
o man bodies, protein molecules, space, underseas and power plants. Other 
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applications include industrial training, and "client presentations" in the 
form of visualization of items such as housing and furniture, as well as 
aircraft, real-estate developments and other large projects. VR would also 
be wonderful for education, but it will probably reach children as games 
rather than as education, just as current computer technology does. Medi- 
cine looks promising, but it generally requires higher resolution than is 
widely available at present and will probably get entangled in regulation. 


Both AI and VR benefit from reproducibility and consistency. With AI, the 
same profile of credit risk gets the same rating each time; the system al- 
ways turns off the valves when certain dangerous conditions are reached. 

VR offers similar benefits: Everyone in the company is working with the 
same model; the model you feel is the model I feel. A car manufacturer, for 
example, no longer has to rely on clay models, but can simply ship a com- 
puter file to its various design centers around the world and keep the vari- 
ous iterations of it in an electronic archive. Better yet, Alice in Germany 
can walk through her work with Juan in Detroit in real-time (with a good 
enough phone line). But none of these changes need be permanent; you can 
store any intermediate model as a computer file. 


Virtual reality has the potential to change the world for designers much as 
spreadsheets did for financial planners. It’s not so much that you can pro- 
duce new "results" with the software, but that the software makes it so much 
easier and more interactive to do so. The outcome is that more people get 
into the act, products are designed and redesigned more quickly, and quality 
improves more rapidly. It's less trouble to fix things. But building these 
models and programming their behavior is tough -- and until it’s easier vir- 
tual reality can't take off. 


Every time we look at VR, we discover that we are looking at 
ourselves, not at a digital input stream or the needs of symbol 


processing... Our body is our interface; the interface is not 
out there in the screen... Realism is not at all necessary; 
people will bring to the experience any amount of cognitive 
flexibility... Perhaps psychology is the physics of VR. 


-- William Bricken 


The market 


Overall, virtual reality will probably save money and provide opportunities 
for its users -- designers, engineers, and other people who work with models 
and simulations -- before it makes significant money for most tool vendors. 
The biggest market will probably be "clip-worlds" from companies that don’t 
yet exist. Meanwhile, current players include Autodesk and privately owned 
VPL Research, co-founded by VR wizard Jaron Lanier. Indirectly, DEC and 
Silicon Graphics will be prime beneficiaries through the use of their hard- 
ware. Loosely defined, the market is worth about $20 million this year. 


Virtual reality encompasses such an eclectic range of capabilities that the 
consumer and business markets will be quite independent. Mattel has sold 
more than 850,000 VR-inspired Power Gloves (with technology licensed from 
VPL, below) for use with Nintendo sets, but they have been no more than joy- 
stick replacements until the arrival this fall of Super Glove Ball (a game 
that lets users operate a simulated hand on the screen). It will probably 
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take years before VR becomes a mass-market phenomenon -- consumers sharing 
virtual environments or creating virtual identities -- that will generate 

fos sizable revenues and have any social impact. That is probably inevitable 

ka eventually, but we believe home fax is likely to sweep the nation first. 
Virtual reality is something you have to do, whereas fax is something you 
own and use when you need it. (Proponents say you get to participate; the 
rest of us acknowledge that people are lazy and generally prefer to watch. 
What do you call a virtual-reality couch potato?) 


It’s not about experiences so much as about shared experiences. 
It’s not the television; it’s the telephone. 
-- John Perry Barlow 


Who sells it? 


Virtual reality is too broad an idea to be defined by a single company, 
product or approach. Standard hardware vendors such as DEC and Silicon 
Graphics stand to see sales of their regular equipment expand as it's used 
to support virtual reality with software purchased elsewhere, and DEC also 
has its own project in the area, which it calls presence technology (a good 
reminder that this field is as broad and variegated as AI). Vendors of 
modeling software may tailor their tools or provide add-ons or foundations 
specifically for virtual reality, as Autodesk is doing, or may simply help 
people create models that can be used with VR systems. 


In the VR-specific end, there's a need both for sensory transducers and be- 
havior transducers, which operate symmetrically. Sensory transducers take 
physical input and turn it into digital commands and messages for the digi- 
tal, virtual world; behavior transducers take the virtual behavior generated 
by each object (in response to those messages and in accordance with its own 
programmed behavior) and turn it back into sensory output or signals (image 
and voice and force in touch-feedback devices) for the user to receive. The 
sensory transducers generally use sensors in the user's clothing or an image 
processor that might watch the movements of a head or hand; they also have 
digital-signal-processing units (not in the devices themselves, but in at- 
tached black boxes). The virtual world and its objects sit in the middle, 
Interacting with the inputs according to the methods programmed into or in- 
herited by each object (computed on DEC or Silicon Graphics hardware). "En- 
vironmental" things such as walls or sky are also objects in this context. 


The virtual operating environments in development at a number of sites all 
manage the interaction of these modules and their component objects, much as 
UNIX or 08/2, say, manage applications and their communications with various 
input and output devices. What’s different is that most applications don’t 
interact with each other as vigorously as the objects in a virtual world do, 
and there’s generally less real-time data floating around. The principle is 
the same, but there’s a lot more coordination required, and ultimately great 
opportunities for parallelism. 


This is by no means a complete survey, and leaves out many pioneers in the 
field, from Ivan Sutherland and Myron Krueger on. Currently, Digital Equip- 
ment has a VR/telepresence research project, focusing on user participation 
in developing prototypes, and the ultimate use of VR environments for par- 
ticipatory design. The University of North California at Chapel Hill is 
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working on a variety of projects including medical, molecular modeling and 
telerobotics applications spearheaded by Warren Robinett, a co-founder of 
the Learning Company creator of head-mounted display software for NASA. 


VPL Research: Virtual reality is our only business 


VPL Research, a leader in the field and the most active vendor, sells trans- 
ducer hardware and some related software in a set of modules that cost about 
$50,000 in total. The hardware includes the EyePhone and AudioSphere (a 
headset through which you "see" and "hear" virtual reality), and DataGlove 
(which uses optical fiber to sense your gestures). The software, Reality 
Built for 2, includes RB2 Swivel, a tool for building mechanical models (li- 
censed to Paracomp and very successful as Swivel 3D), and Body Electric, for 
defining the behavior of the world and its objects. The software tools run 
on Macs; they generate “behavior transducer" software to run on Silicon 
Graphics or DEC machines, which run another $100,000 or so. 


Flex, Body Electric’s incrementally compiled visual programming language, 
approaches the programmability we espouse. It uses boxes and.arrows to in- 
dicate input-output flows and event sequences, and it can not only describe 
object features but also specify object behavior, such as "move left if you 
hit a green wall and right if you hit a red wall," or "insert yourself into 
the nearest matching hole." (The boxes themselves include text.) Body 
Electric also includes a lot of defaults that the user may accept or modify 
with Flex, such rules about gravity, distance and solidity of objects. Its 
major flaw: It works in real-time, but not in virtual reality; a programmer 
sitting at a console can alter the behavior of a VR object while it’s in ac- 
tion, but the user can’t do it from within virtual reality. VPL is working 
on such a within-VR language, code-named Embrace. 


Look at a two-year-old. We're talking about waving your arms, 
pointing, single word gestures, at least single-word commands, 
toddling around; that’s the kind of behavior that ought to be 

running computer systems. At the software level, we're trying 
to develop inclusive computation, something that surrounds you. 
The idea ‘: software that simulates environments rather than 

windows on environments. -- William Bricken 


VPL was co-founded in 1985 by Mr. Outside Jaron Lanier and Mr. Inside Jean- 
Jacques Grimaud. (VPL initially stood for Visual Programming Language; now 
it’s Virtual Programming Language.) Ceo Lanier was formerly a free-lance 
video-game designer and also did work with Atari; president Grimaud had ear- 
lier founded Micro-Archi, a before-its-time palmtop computer vendor. Fund- 
ing was bootstrap mostly, with royalties from Lanier’s Moondust video game 
and a little private money from friends such as MIT’s Marvin Minsky, and a 
later infusion from the French electronics company Thomson CSF. 


VPL already has 500 customers, including Pacific Bell, several NASA loca- 
tions and companies in such areas as auto and aircraft design, medicine, and 
even consumer marketing. NASA Marshall has ordered VPL equipment to replace 
big physical models of a space station. Matsushita is planning a simulated 
kitchen to market its appliances: Consumers can bring their own floor lay- 
out to a virtual reality showroom and select and position virtual appliances 
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in their virtual kitchens before buying. Overall, VPL has sold somewhere 
between 50 and 100 full systems, with the remaining customers buying just a 
component or two for research or pilot projects. 


VPL is sticking to the high end of the market, and in fact is already prof- 
itable by dint of sticking to its knitting and not going too early after a 
broader market. (It’s addressing that market in a joint effort with Logi- 
tech to develop a low-priced DataGlove for use with screens, and with its 
license to Mattel for the Power Glove.) The company has about 35 people, 
including two sales engineers. Most of its larger customers are technically 
capable themselves, and have a fairly close relationship with VPL’s non- 
sales engineers. "As a company we're after markets where there's a need and 
where we can provide something others can’t," says Grimaud. “It’s a first- 
person experience. We're not trying to replace existing Alias [rendering] 
systems, but more provide the experience of being in the driver's seat." 


The major competition, he says, is the old way of doing things. An aero- 
space firm, for example, is using VR to do prototype airplanes, replacing 
some physical models and current visualization software on workstations, for 
simulations to study human interaction in the cockpit and how best to carry 
out certain maintenance procedures. 


Autodesk: VR is another arrow in our quiver 


Also active in the market is Autodesk, which already has the world’s largest 
(in units, not dollars) installed base of computer-aided design software, 
with half a million users, and a habit of openness to third-party add-in and 
add-on tools. It hopes to have a VR environment out next year. Its virtual 
reality team has gone through some turmoil over the last year as the company 
focused on more immediate commercial efforts (cf. the experience of its Am- 
erican Information Exchange subsidiary, Release 1.0, 90-7). William Bricken 
(below) and a number of other researchers have left, but the Cyberspace pro- 
ject continues with eight people, led by Randy Walser, who worked on tele- 
robotics and AI at Advanced Decision Systems and on video games at Bally/ 
Midway before joining Autodesk in 1988. As in Autodesk's basic AutoCAD bus- 
iness, says Walser, "We're trying to reach developers now, and get VR tools 
into their hands. We're building a broad-based distributed simulation sys- 
tem that’s open but ties in intimately with AutoCAD." 


The whole thrust is to make abstract things more tangible. 
Long run, the business is the worlds or the models, the content 
[-- which will be built by Autodesk users and developers]. 

-- Randy Walser 


The system is called Trix, a word that has a flavor of UNIX to it, and also 
something of “tricks human senses." At Trix’s core is a world-simulator 
that manages the virtual world created by a developer. It maintains a list 
of the virtual objects and their runtime addresses, and knows at what point 
to give over control. It is written in C++, and object-oriented, construct- 
ed so anyone can plug in anything, in any language, either in advance or at 
runtime. Thus the objects it manages can be written in any language -- or 
with almost any design tool, not just AutoCAD. It also manages messages 
from the "user object," and manages and translates (transduces) return mes- 
sages from the objects to the display and other output systemg. 
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Trix is designed to let developers to create virtual worlds with virtual ob- 
jects independent of input and output devices (call it Windows for virtual 
objects). Users can buy their own preferred variety and power of such de- 
vices, as long as they follow minimum Autodesk conventions. As the most 
mass-market CAD vendor, Autodesk well understands the value of openness, and 
is willing to sacrifice proprietary special effects for generality and an 
interface that is easy to talk to. The system runs now on 386es and 486es 
with DOS, and will also come out in Mac and SPARC versions. 


Human Interface Technology Lab: Let’s win the VR race! 


Autodesk's loss of William Bricken was the University of Washington's gain. 
Both sides agree that he belongs at Washington's Human Interface Technology 
Lab, where he can pursue high-end research into the psychological and mathe- 
matical implications of virtual reality rather than build a market-driven 
product. As part of the research, he is running the development of the Vir- 
tual Environment Operating Shell, comparable to Autodesk’s Trix but higher- 
end. It runs on workstations and will eventually support parallelism, and 
is written in C and LISP. Bricken is still in contact with Autodesk, and 
the two groups are working together to ensure as much interoperability as 
possible. "It’s too early for standards yet," says Bricken, "but we do need 
conventions for object interchange and input data formats." 


We're also working on a headmount technology called a laser mi- 
eroscanner. Rather than have a CRT or LCD generate an optical 
image in front of your eyes, the idea is to have a low-power 
laser project the image on your retina. Instead of pixel ad- 
dressing, we are talking about rods and cones addressing. 

~- William Bricken 


HITL is run by Tom Furness, who earlier ran a “super cockpit" project for 
the Air Force. It has 10 staff members and 12 students, and has created the 
Virtual Worlds Consortium to attract funding and to raise the credibility of 
virtual reality in general. Members include Digital, Alias, VPL, US West, 
Sun and others soon at $50,000 per year. For that they get pre-release ac- 
cess to the lab’s work and a way to extend their own research efforts. 


However, a forthcoming meeting of a Japanese “study commission" sponsored by 
MITI (October 10) in Tokyo will probably do even more for the field, just as 
Sputnik spurred our space program three decades ago. The study commission 
members include Tokyo University, NTT, Toshiba, Mitsubishi, Sharp, Sanyo, 
Matsushita, Fuji-Xerox and Nintendo. 


The glorious future: Clip-worlds and power to the user 


Eventually, software clip-worlds will outsell headgear and gloves. The real 
potential of this technology lies in the power it will ultimately give to 
users to design things -- real or simulated -- the same way drawing packages 
let users build images with clip-art and (increasingly) graphics object li- 
braries. Virtual reality is simply a feedback mechanism. 


But users need more than just canned worlds. It’s not just the ability to 
operate within the 3D environment that’s so important. In fact, in many 
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cases you can get the same knowledge from looking at a screen, although the 
impact is greater with VR. In other cases, such as operating equipment re- 
motely, the interactiveness of VR is key. But the real value of VR will be 
the ability to create and program those environments from inside. 


Skilled programmers can now create virtual-reality environments for design- 
ers and other industrial users (or wealthy consumers) to "work in" and man- 
ipulate, but virtual reality is not immediately programmable by its users. 
Although VR provides direct experience and direct manipulation capabilities 
to the users of its virtual worlds, it’s a long way from giving them the 
same powers as the builders of those worlds and the objects in them. You 
can move things around directly and even modify them slightly within VR, but 
to tell them how to move around when you aren't there to do it yourself (or 
how to interact with each other and with other users), you have to go out- 
side the system and use a tool such as VPL’s Flex. 


The currency of VR is organization, not possession... VR is 
illogical positivism: If you can specify it, it is meaningful. 
All empirical hypotheses are true. 


-- William Bricken 


The essence of programming is using symbols and variables and rules so you 
can manipulate whole groups and classes of things, while direct manipulation 
allows you to move one thing (or group) at a time, interactively. Lanier's 
goal is to combine both, by bringing the capabilities Flex and beyond into 
wo virtual reality. People will end up discovering the limitations of VR much 
oy as people discovered the limits of direct manipulation with page-layout pro- 
. grams ~- it’s nice to move things around on the page, but do you have to do 
every page? You want new chapters to start on new pages, and figures to re- 
number themselves automatically when they're moved. Likewise, in a virtual 
world, you don’t want to have to put tops on all the houses; you want them 
to slide into place automatically, each sized to fit the house it covers. 


VR as social phenomenon: The experience is the message 


So what about the second vision? While businesspeople (and the Defense De- 
partment) are happily exploring the potential of virtual reality for “use- 
ful" tasks, artists, sociologists and entertainment types are exploring its 
use as the communication medium of the future. Yes, this isn’t just another 
form of television. You don’t sit there and watch; you jump in and get in- 
volved. The point isn’t the individual's experience but rather the trans- 
ferability of the experience, which can be shared across space or time. The 
goal is not to communicate with the computer but through it. 


Still, people are only half-right when they say, "VR is not television; it’s 
the telephone." It’s not the telephone either. It’s a medium of expression 
more than of communication, like music or art. After all, most of what peo- 
ple communicate about concerns not just physical things -- things that can 
be adequately represented by the five senses (let alone just two or three of 
them) -- but people, ideas, feelings, events, which operate within social 
structures, not in physical space. How do you simulate a promotion, the 
TN long wait you had at the post office (please don't make us live through that 
oes again!), your desire to have dinner with someone? 


Release 1.0 8 October 1990 


12 


D a ae r ee en NT aaa 


Now that we can represent reality directly, why use symbols? 


In the end, reality is more than physical presence. It’s the rules and con- 
texts that govern things -- rules of human behavior, human memories, etc. 
Take a cat. The representation of the cat may be exact, but the meaning, 
the resonance, the implications of the cat are not inherent in its physical 
representation. Even if you could in fact reproduce the cat, most of its 
meaning lies in its history, not in its physical presence. Otherwise, we 
wouldn't spend lifetimes and millions trying to analyze dreams. 


Please, if there is anybody here from the press, this is not 
electronic LSD. As somebody from Autodesk said recently, it’s 
going to be a long time before it approaches the price/perfor- 
mance ratio of LSD. But it is a real good tool for getting 
people who might be a little Newtonian and deterministic to 
recognize that reality is an opinion and not a fact. [Lack of 
this understanding] is the seat of intolerance. If my reality 
is the reality, I can do anything I want in the service of that 
reality... 
I want to distinguish cyberspace from virtual reality... 
[Cyberspace] actually exists now. Cyberspace is where all 
kinds of electronic informational transactions take place. 
Cyberspace is the place where you go when you talk to the 
phone. Cyberspace is where the money is... Much of commerce 
in society at this time takes place in...cyberspace. It’s a 
frontier kind of place. It takes a lot to maneuver around in 
it... The answer to the alienation [of cyberspace] and data 
shock is to a large extent being able to inhabit cyberspace as 
a place, being able to go in there and be somebody. 

-- John Perry Barlow 


If one uses a word such as house, it may be fairly neutral, but the moment 
you display or virtualize a particular house, with French windows, say, or 
an Eichler, a hovel or a mansion, it evokes reactions. It symbolizes some- 
thing to the other party, whether you meant to or not. Suppose the generic 
person Alice creates reminds Juan of his mother? Virtual reality makes you 
be more specific than you may want to be. With symbols, you can represent 
only the attributes that you intend -- and even then your receiver may mis- 
perceive your meaning because of his own associations. 


The problem with VR is that it creates the illusion of complete communica- 
tion. With words, we know there's ambiguity, incompleteness, misunderstand- 
ings. With virtual reality, we're less aware (as yet) of the lack of ab- 
stract representation -- analogy, generalization, rules, specifications. 


So, yes, there will be a consumer market for virtual reality, but in the 
short run it will be closer to the market for musical instruments or pre- 
recorded cassettes than the market for telephone service. Long-run, people 
may build their own virtual-reality manifestations, and there may be a huge 
business in virtual-reality parlors, virtual-reality models, virtual-reality 
modeling tools, and so forth. But whatever anyone tells you, virtual real- 
ity is only a set of capabilities for modeling one aspect of reality -- the 
physical part. Like artificial intelligence, it has its own, powerful capa- 
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bilities and unique functions, and will be useful not only in itself, but in 
extending the way we think about reality, symbols and physical manifesta- 
tions much as AI has extended our thinking about problem-solving, cognition, 
language -- and even about thinking. But in no way is either artificial in- 
telligence or virtual reality a replacement for the real thing. 


Whenever I want you, all I have to do is dream... 
Only trouble is, gee whiz, I’m dreaming my life away. 
-- Everly Brothers 


Juan & Alice in virtual reality: Some intriguing social questions 


While we don’t think virtual reality will replace physical closeness -- and 
for most business meetings a teleconference is good enough -- the notion of 
virtual selves has interesting implications even beyond such social addic- 
tions as to video games, chess or any other medium for escapism. Long ago, 
one's appearance was more or less a physical fact of nature; nowadays, it 
indicates social and financial status. First it was cosmetics, then cos- 
metic surgery. In the future, it may be one’s virtual self. Here are some 
imaginary snippets of conversation, circa 2084: 


“Jaron looks awfully scruffy these days. Can’t he afford a good designer?" 


"But Mom, all the other kids are doing it. How come I’m the only one who 
can’t have a virtual self with holes in the wings? It’s just not fair!" 


"Mitsukoshi-Marcus is having a special on designer selves by famous post- 
Symbolic artists. Visit our virtual studio today by picturephone or..." 


In September: "Christmas starts earlier and earlier! Everyone’s red and 
green already!" 


"I'm sorry, sir, he’s in another world with an important client right now. 
Can I have him get back to you?" 


"Like, she instantiated a totally awful self at that conference! It was em- 
barrassing! She just doesn’t have any taste!" 


"Looking for a new career? Visit our virtual-self consultants before you go 
on those all-important virtual interviews!" 


Finally, can you program your virtual self to take over for you while you're 
otherwise engaged? It’s just an extension of the voice-mail system, right? 


[Except for the last one, the quotes in italics come from a SIGGRAPH panel 
last summer, which also included panel leader Bob Jacobson of HITL, Warren 
Robinett of UNC, Tim Leary and Esther Dyson. These fragments can be found 
in context in the SIGGRAPH ‘90 Panel Proceedings, which will be published 
early next year. For information, call Leona Caffey at (312) 644-6610.] 
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TOOLS FOR DESIGN: VISUAL THINKING 


As we noted last April (Release 1.0, 90-3), visual tools are ideal for ex- 
pressing both sequences of procedures and flows of work among people, 
whether or not you intend to automate them. (And you can’t automate them 
effectively unless you can express them clearly.) These are concepts that 
inherently have dimensionality and can easily be expressed visually. The 
precise actions taken and the objects they act on, however, are generally 
best represented symbolically: they are groups of things or variables, and 
procedures .+ By and large it’s not graphical curlicues and icons that mat- 
ter in visualization of structure, but the relationships between items, 
which could just as well be labels in plain boxes -- whether part-of or 
kind-of relationships for data, or follow-from, choose-among, lead-to, etc. 
for actions, or input and output boxes as with VPL’s Flex (page 8). 


Programmers have been using such tools for some time, generating flow charts 
and data diagrams and state-transition diagrams, but end-users have mostly 
been baby-fed menus and programming-by-example tools: Draw your data in the 
windows, show what you'd like to see, and we'll write the code for you. Or 
they write low-level step-by-step macros: Move 3 steps right, select item, 
display. Or, open file "c:todo.lis" -- and let the user take it from there. 


For noncoders, visual representations are a wonderful medium of communica- 


tion: "No, that’s not what I mean. This should go here," is a more useful 
response than, "I guess it looks okay; I can’t understand all this computer 
code. We'll try it out and let you know." Kinks in a system get discovered 


early. Visual representations are sort of a simulation, with time trans- 
formed into a physical dimension on the screen (or printout). 


The two new products described below make the transformation between visual- 
ized structure and words/code elegantly and simply, each in its own way. 
Calypso is a programming tool for workflows that lets you code and visualize 
or visualize and code as you prefer; AllClear is a thinking tool that helps 
both programmers and non-programmers to think clearly by automatically gen- 
erating a flow chart or diagram of any set of procedures or decision steps 
from a clearly written description of a sequence of events and conditions. 


CALYPSO: TASK BY TASK, PERSON BY PERSON 


Groupware is an ideal application for visual programming. It’s intuitive 
(far more than rows and columns) to represent workflows as arrows and bran- 
ches between boxes representing people or departments or decision points. 


High-end workflow groupware, like mainframe software (and the financial 

planning systems of old) implies central control, but there’s also room for 
simple processes that could be modeled and "programmed" by end-users. While 
representing the flows is easy, it’s tougher to build a rigorous system that 


1 "Procedures" can be refined into sequences of smaller procedures which 
can also be represented graphically. The trick is to have a hierarchical 
system that allows you to look at the desired level of detail, generally by 
"zooming" in and out. But you can zoom with a labeled box as easily as with 
a cute icon. 
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can convert those flows into code, so that the representation becomes an ex- 
ecutable expression rather than just a pretty drawing to guide a programmer 
in his coding. This capability, we believe, will drive the spreadsheet of 
groupware: a tool to enable workers and managers to mock up simple proce- 
dures as easily as analysts do simple forecasts. 


For example: Juan gets the phone call and types the customer’s name and ad- 
dress into a form for entry into the database. Then he sends it to Alice, 
who does the actual work -- usually sending out a letter or a free sample -- 
and records that action in the database. In some cases, she needs to tell 
Fred, who sends out a bill (and records the payable in the database). After 
this process takes place a few times, Juan might decide he'd like to auto- 
mate the workflow, and construct a little program to do so. Call it "in- 
structing" the system if you want to be extremely user-friendly. (You might 
wonder if Juan couldn't do Fred's job too by interacting with the database, 
but that’s another story, and a longer-term implication of the trend to 
automation of routine procedures that groupware implies.) 


The success of groupware "spreadsheets" depends not just on 
visualization and ease of use, but also on the creation of ap- 
propriate sales channels and on control issues. Just as MIS 
wants control of data, so does it also want control of applica- 
tions. "I start with end-users and network managers," says 
Tony Kobine, "but invariably it goes to the MIS people." 


In the beginning 


One of the first such attempts was Staffware, developed by Tony Kobine at a 
UK company called FCMC five years ago (see Release 1.0, 86-2). But the 
product lacked a visual component and it used its own proprietary database. 
Based on UNIX, it took over the user’s system entirely and didn’t effective- 
ly Integrate with the user’s own tools. 


FCMG is now benefiting from a new version of Staffware and greater penetra- 
tion of UNIX in office environments. It is most active in the UK, although 
it sells in the US through Unisys. Kobine left the company in 1988 to found 
Systems in Concert and work on a successor product that would solve the 
problems of version one and address the much larger pe market that now ex- 
ists by running on DOS and over pe networks. 


In the present: Calypso 


The new product, Calypso, works in DOS as a TSR (except in administration 
mode), so users can keep their familiar applications and perform a variety 
of tasks beyond the capabilities of Calypso itself. The system routes tasks 
according to user instructions, and can make decisions on the basis of user 
data, its own data, and factors such as the date and time. It keeps its own 


metadata -- transaction-logging, routings, the files and data required for 
each step -- in xBASE (dBASE or a clone). It can load user applications 
and, with a little programming, move some data back and forth between the 
user’s applications or to and from itself -- into a mail-merge file, say, or 


a spreadsheet, so that Alice can work on a letter that already includes the 
name of the customer entered by Juan in the previous step. 


Release 1.0 8 October 1990 


16 


The programming ("instruction") process overall begins either with the 
graphical layout of the steps or with the definition of each individual step 
-- depending on your preferred approach. If you start with the sequencing, 
you build the sequence by placing boxes (from a palette) with a mouse in 
whatever order you like, and connecting them with arrows. A single box can 
branch into a number of steps (either concurrent or alternative), and multi- 
ple steps can converge to a single one. 


For each box, you fill in a form to specify the content of the step: who 
does it, what applications and data files are needed (with variables for the 
file names, records or key indexes if you want to bind the step to specific 
data). This is the point where a programmer, or at least a dBASE expert, 
may step in if the routing is complex or the system needs to do more than 
just load an application and a file for the user. In addition, someone has 
to set up the network and the user IDs. But an ordinary user could probably 
figure out how to send an expense-account spreadsheet through an approval 
cycle, from the spender to the sales manager to the accounting department. 
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Nonetheless, Calypso still doesn’t qualify as our spreadsheet for groupware. 
The fault lies not in the groupware tool, but in applications that are in- 
accessible except through cumbersome, cryptic APIs. Calypso is as far as 
anyone is going to get who doesn’t own the system ~- as Patriot Partners 
will, and as H-P’s NewWave, AT&T’s Rhapsody (based on Workhorse and NewWave 
and now also licensed to Xerox), IBM's OfficeVision and NCR's Cooperation do 
at least in part. (None of them has achieved it yet either; more on that in 
a future issue.) 


Kobine is taking a pay-as-you-go approach to marketing. Right now, he’s 
selling direct to large customers, and hopes to expand his reach by using 
dBASE consultants to sell and set up Calypso systems for smaller customers. 
The system costs $5000 runtime and $10,000 for the developer version. For 
dBASE consultants, Calypso will be a good way to leverage their capabil- 
ities. For groupware, Calypso is a good way to enter the market without 
looking too "weird." And for users, it’s a good way to increase not per- 
sonal productivity, but office productivity -- not more forecasts per hour, 
but more customers handled per hour. 
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ALLCLEAR: STEP BY STEP 


AllClear is a procedure-debugging tool from Clear Software, the company that 
brought you Clear. Clear can read Dbase code (and now C) and generate a 
flow chart. AllClear takes human "programs" and performs the same transfor- 
mation -- from a series of steps, rules, and choices, into a neatly drawn 
chart showing a user what to do. In one way, Dbase and C are tougher to 
handle, since the languages and programs can be complex; in another, they're 
fairly simple, since they both follow a rigorous, defined syntax (even 
though it’s complex, it’s complete). Clear simply has to parse the code and 
figure out the best way to draw the structure (no mean feat itself). Its 


inability to handle incorrect code is a feature -- bug-detection. 
Human language is so much less precise -- intractable, for practical pur- 
poses -- that founder/developer Yasinovsky bypassed it by settling on a 


small, simple grammar/syntax for his users. Paragraphs, yeses and nos, and 
sentences ending with colons or question marks all have defined meanings. 
AllClear treats everything else as noise and puts the rest of each paragraph 
into a black box, which holds the "content" of each step. Users still feel 
they're writing English -- they are -- but they are also following rules as 
rigid as (if less extensive than) those of Dbase or C. Each paragraph de- 
fines a step. If it ends with a colon, the next sections are choices, in 
if-then form, which end in periods. 


If the paragraph ends in a question Are you tired? 
mark, the next two sections must be (Yes) Go to bed. 
yes or no. And so on. (No) Keep reading! 


What you see is what you meant? 


AllClear then generates a flow chart of what you have described. The value 
is both in the precision it imposes, and the clarity with which it displays 
the result. By forcing the syntax on you, it shows you the semantics so you 
can see where you may have screwed up. (It can also arrange data from a 
spreadsheet or database into an orgchart or tree; for example, everyone with 
the same salary or job title would be grouped together into one branch.) 


AllClear is a tool for people to express knowledge they already have. How 
do you fill out a Federal Express form? Where do you file an expense re- 
port? (Or what checks do you go through to approve one?) Who handles the 
customer complaints, and how does she resolve them? What steps do you take 
to announce a new product, organize a customer seminar, change a price or 
qualify a new supplier? Ail of these tasks follow routine procedures, even 
though some of the steps -- such as mollifying a disgruntled customer over 
the phone or picking a price for a new software product (such as AllClear, 
$300) -- may take unique human skills or insight. 


AllClear assumes the user could understand the process if only the steps 
were laid out intelligibly. It deals with the development phase before the 
expert system or the groupware tool comes into play. Expert systems and 
groupware are basically sets of rules and conditions; AllClear lets you see 
how it all fits together. AllClear solves the problem not of automating a 
process but of defining it properly, so that people can see what they're 
doing -- or what they're not doing. It provokes responses such as, “Oops, 
we never figured out what to do if the recipient doesn’t have fax or telex," 
or, "So we said what to do when people go on vacation, but how do we trans- 
fer the unfinished work back to them when they return?" 
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Personally, we'd like to use AllClear on those voice-mail systems that send 
you into the blue yonder after ten sets of "Press one if..." We're sure the 
problem would become apparent right away. (The basic problem is that this 
is a system that should not be automated. You can never truly predict what 
a random caller might want, and it’s clear that many callers want a human. 
Certainly, they do not want to travel up and down a cryptic menu tree -- at 
least not until we all have picture phones and callers can see the menu.) 


Think clearly before you automate! 


Technically, you could automate most of these procedures as an expert sys- 
tem, leading the user through a set of questions and giving him an answer 
(or someone to talk to) at the end, or as groupware. They embody expertise 
that it would be nice to be able to represent with software. However, fre- 
quently the point is not the answer at the end, but the process itself, 
which may not need or may not submit easily to automation. Second, tradi- 
tional expert systems tend to keep the user in the dark; they lead the user 
without telling him where he’s heading and with the implicit message that 
such things are too difficult for him to understand. That can be helpful if 
the process is extremely complex, but with simple office procedures it's 
frequently helpful rather than confusing to see the paths laid out. 


Doing market research for the product, Clear’s Yasinovsky was 
surprised to find out how many flow charts are actually in use 
-- pilots’ manuals, product-assembly instructions, a tax manual 
from the Financial Accounting Standards Board (200 pages of 
them out of 700 pages in total), patent applications (including 
Clear’s own). And tree structures abound as well -- for org 
charts, bill of materials breakdowns, or anything that can also 
be represented as an outline. 


AllClear focuses on personal productivity before you even get to the com- 
puter. As you've heard before, if you automate a mess, you get an automated 
mess. With AllClear, you may get rid of the mess before you automate -- or 
discover you don't need to. It’s that last step, automating the human work 
at each workbench, that’s really hard (and is the province of most of the 
exotic software we write about). But delivering the right tools to each 
workstation, and moving the work reliably from place to place so that the 
work can be done, is worth diagramming and doing well. 


The fundamental problem isn’t automating procedures, but designing the right 
procedures in the first place. AllClear can only show you whether your pro- 
cedures work in logical sequence and can’t assess whether they make sense, 
but it can make them visible, so that it’s easier for a person to make that 
determination. The structure may be sound, but it’s only when you see both 
the trees and the forest together that you can determine if it makes sense. 


Often, it’s enough to represent a process, and maybe speed it along, elec- 
tronically, but you still want humans making most of the decisions or doing 
most of the talking -- on that phone system with customers, for example. 
You still want people, not robots, to interact with customers. 
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DB SOFTWARE: DATA-DRIVEN DESIGN 


Despite the best efforts of Ted Codd among others, databases are not mathe- 
matical abstractions. They’re full of messy data (even non-object-oriented 
ones), with trade-offs, opportunities for optimization, and those little im- 
perfections that distinguish reality from models. Designing a database to 
accommodate real data requires not just algebra but a complete description 
of the data elements and the way they relate to one another -- a data-driven 
design process. Just as users need visualization to see the structure or 
metadata of what they're doing, so do database designers need the reverse -- 
a way to see the data in the structure, to check if it makes sense and 
matches reality. While database design is a fairly technical, abstract art, 
the data itself is real and messy (hence the need for object-oriented data- 
bases), and in the end the database must accommodate reality (more or less). 
The data the database will hold is not precisely predictable but it is gen- 
erally statistically describable. Thus what the database designer most 
needs is a way to visualize the data -- not the numbers or averages or 
trends, nor even the metadata of the model -- but the actual relationships, 
which can best be done with intelligent sampling. 


Currently, most database designers use top-down entity-relationship diagram- 
ming tools from vendors such as Index, Bachman, KnowledgeWare and Cadre. 

But while these tools can give you a nice idealized picture of the relation- 
ships you have defined, DB Software's RE/generator helps you to discover the 
hidden structure based on the actual data. It can be used either for re- 
engineering based on real data (rather than just data catalogues), or for 
forward engineering based on real or hypothetical data. 


DB RE/generator is part of a larger suite of tools that help you do database 
design, maintenance and tuning in general. It has hooks for trading models 
with entity-relationship diagramming tools and database catalogues (database 
specifications) from the standard sources -- DB2, IMS, Oracle, etc. For ex- 
ample, you can import a database model, refine and normalize it, export it 
to look at the diagrams, modify them if you want, and then reimport it and 
let RE/generator generate the right SQL statements for the database schema 
you have designed. The first release does forward-engineering only, and 
will be out next month for $10,000. It can import models from Cadre Tech- 
nologies’ Teamwork and generates SQL for Oracle or DB2 databases (so much 
for "standard" SQL). The full $20,000 version described here won't ship un- 
til early 1991, although it already performs its basic functions correctly. 


Forward engineering: Design by example 


RE/generator lets you design your tables more or less the traditional way, 
specifying domains, columns and rows (or attributes and relations), with a 
set of menus and forms. It also helps you define the functional dependen- 
cles between fields (shown with arrows below); i.e. where A always implies B 
although B does not always imply A. (Juan’s boss is always Alice, although 
Alice has other reports than Juan.) For example, does a given name always 
imply a given address, or vice versa? It’s pretty obvious to a person that 
a given part has only one name, but how does the machine know? Moreoyer, 
the same name may have several part numbers, depending on size, say. And 
the customer may always have the same shipping address -- until Christmas, 
when Juan suddenly orders things for Alice as well as for himself. You're 
in trouble if your database can't accommodate these anomalies. 


Release 1.0 8 October 1990 


20 


RE/generator lets you can validate the functional dependencies you have 
defined with cooked-up data in "example tables" that have all the relevant 
combinations, with one example of each: Same name, same address, different 
order number, different part number, different number of parts, and so 
forth. For example, anyone who sees the table at left below... 
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The table at left above was built Specifying functional 
with RE/generator to satisfy the dependencies 
following functional dependencies: 
part number determines part name 
customer determines address (i.e. 
one address to a customer) 
and violate this one: 
address determines customer (two 
customers at one address) 


... will instantly notice that "item 217-398-0700" is always a “gold-plated 
corkscrew," and that customer "Fred Bloggs" always lives at 290 Maple Ave- 
nue. These example tables are generated by the product (from examples sup- 
plied by the user) in accordance with the functional dependencies. But if 
the designer thinks long enough he may want to add a record showing Mr. 
Bloggs at 40 Crescent Hill -- to allow for multiple addresses. 


He may also decide he doesn’t want the same part number for different sizes; 
each part should have a suffix indicating size. Nor should a single order 
include multiple shipping addresses or delivery dates; a partially filled 
order should be listed as complete and a new order covering the unshipped 
goods created. These decisions represent business rules and procedures, but 
they come from examination of the data and its structure. RE/generator can 
automatically alter the schema to represent the new functional dependencies. 


Reverse engineering and cleaning dirty data 


Just as it does with hypothetical examples, RE/generator can extract rele- 
vant samples of data drawn from real files in VSAM, IMS, IDMS or relational 
databases, and analyze them to find functional dependencies that may not be 
recognized in the database schema; for example, the schema contains the key 
relationship between part number and part name, but doesn’t recognize that 
the letter prefixes indicate the plant that manufactures each part. Should 
the prefix be listed separately? Likewise, the schema knows that student ID ; 
uniquely identifies each employee, but it doesn’t catch the dependence of ee 
age on date of birth. 
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In the process of finding these functional dependencies, the analyst may 
also discover suspicious functional "independencies" (not a formal term) due 
to dirty data. Not only does Mr. Bloggs have two addresses, but the gold- 
plated corkscrew may be listed once as 217-398-0070, or EDventure may have 
five different spellings. Are these mistakes, “dirty data" that needs to be 
cleaned up, or rare but regular occurrences that should be accommodated in 
the database structure? Some records look like subscription bills, others 
like invoices for a conference; should they go into separate databases? The 
same items have different names in different tables (DB Software cites an 
IDC study showing 20-to-1 redundancy of multiple names in typical mainframe 
sites); how can you find these? 


You could almost say that DB Software founder and ceo Dina Bit- 
ton was born to run a database software company. She was cer- 
tainly named for the job. She founded the company last year, 
after eight years as a professor at Cornell and the University 
of Illinois. The fundamental concepts are hers, but she has 
hired old business hands such as marketing manager Bob Healy 
from Ingres, and software engineers from IBM, Tandem, HP and 
Apple to help take them commercial. Funding of $2.3 million 
comes from Sutter Hill and Oak. 


It’s only by looking at the actual data that the designer can get a good 
feel for the answers to these questions -- and tell them to RE/generator in 
an interactive session which results in a schema that is not only internally 
consistent but also reflects reality. From then on, as you build new rela- 
tionships or otherwise want to change your database structure, the system 
can go through and pick out any data that may violate the new model. 


Feeling the data 


This use of sampling and algorithms for dealing with actual data moves RE/ 
generator beyond even the Bachman line of tools, the class act so far in 
database re-engineering. Bachman derives structure abstractly from defini- 
tions; RE/generator derives it from the data. Using RE/generator is akin to 
letting an architect build models out of real materials rather than drawings 
or computer images. It just feels different; some designers may not need 
it, but others may find the "tangibility" intensely appealing. Users, too, 
will probably find it easier to comprehend relationships embodied in real 
data than the abstractions of entity-relationship diagrams. ("Oops! You 
can't do that! Some of our people work in several task groups and have dif- 
ferent managers for each one." Or, "We only give the discount if they all 
go to the same address, so there is only one address per account number.") 


What RE/generator does is not a question of being smart; it requires looking 
at all the data -- or making the software do so. That is what RE/generator 
does, in a matter of minutes. It considers each field and each combination 
of fields as a key for every other combination of fields. Some can be dis- 
carded pretty quickly; others take longer to reject as, say multiple ad- 
dresses, vice presidents who are not male, and other rare but allowed com- 
binations occur. Built-in statistical thresholds, which can be adjusted, 
prevent dirty data from messing up the process by displaying the relation- 
ship it is testing and the data that contradicts it: Are the different 
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part numbers for the corkscrew a mistake? What about the female vice presi- 
dent? The user can decide and the system will take it from there. (From 
then on, the software can notice and flag inconsistencies for you.) 


In the other direction, when you're designing a database from scratch (or 
from some non-database records), you can use sample records to construct a 
simulation of the database structure and have the system define the func- 
tional dependencies for you. Some people think mathematically; others may 
think less abstractly and find this a better way to design. 


There are a lot of re-engineering tools showing up on the market now, but 
none of them has RE/generator’s sense of closeness to the data. Call it 
virtual reality for databases. The developer gets the feeling that he’s 
working with the real thing, even though he’s using RE/generator’s carefully 
selected statistical sample. 


Appendix: Normalization 


Normalization is a key concept in relational database design (although it 
sacrifices performance to abstract perfection). Normalization means putting 
the data into its cleanest, most "flattened-out" form, so that no data item 
appears more often than absolutely necessary. That is, only unique data is 
kept, and other data is derived through functional dependencies. For exam- 
ple, if you have an order table including part numbers and part names that 
always match, then you really need two smaller tables, one for just orders 
with part numbers, and another that matches part numbers and part names. 
That way you can never have a part name and number that don’t match (al- 
though you can type in the wrong number and get the wrong part). The part 
number itself is necessary data, because it can’t be determined any other 
way; its presence is part of the data for the individual order. 


Likewise, if each customer has only one address, you have a table showing 
each customer and his address, and you don’t repeat the address anywhere 
else -- you get it by asking for the customer’s address. Of course, if the 
customer turns out to have two addresses, you now have a problem. Now you 
need to specify the address with each order, or you could possibly list ad- 
dressl and address2, and use addressl by default. These are the kinds of 
pesky problems database designers deal with all the time. 


The value that identifies a unique element in another table is known as the 
foreign key. For instance, in a typical employee table, the department num- 
ber is a foreign key referencing the departments table. (In an even more 
compact form of storage such as that used by Nucleus (Release 1.0, 88-1), 
the orders might actually be represented by a vector which would have zeros 
except for those positions on the vector representing the parts ordered, but 
that’s another story.) 


Once a database is normalized, developers typically denormalize back to 
structures optimized for the most frequent applications and queries. Denor- 
malization involves putting data back into connected tables for greater ex- 
ecution and query efficiency, so that you don’t need to spend a lot of pro- 
cessing time looking up part numbers. You may decide, for example, to sepa- 
rate area codes and phone numbers, or states and ZIP codes. Theoretically, 
in a normalized database, one should have one table for each day's orders, 
but you'd end up with a mess. (These issues are relevant to the design of 
object-oriented databases, too.) 
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While normalized data structures are abstract and mathematical, there may be 
several ways to denormalize, with various trade-offs for performance, redun- 
dancy and storage. The way you denormalize, obviously, has a great impact 
on efficiency both of execution and of storage, and depends a great deal on 
the data itself: How many different values in a particular field? How many 
records in a particular table? (Next come efficiencies of query execution: 
Do you select from table A and then from table B, or from table B and then 
table A? If A is much larger, you're usually better off starting with B.) 


This is perhaps the most painstaking part of database design; it’s a black 
art. Either you're planning for data that mostly doesn't exist yet, or 
you're working with existing data. Either way, it’s tough to do the design 
because the problems are not abstract: The trade-offs depend on the data 
itself: How often do customers have second addresses? Do orders typically 
contain several items or only one? How do salaries compare to job titles? 


RESOURCES & PHONE NUMBERS 


Randy Walser, Autodesk, (415) 332-2344 

Vadim Yasinovsky, Clear Software, (617) 232-4720 

Dina Bitton, DB Software, (415) 328-0601 

Michael Good, Digital Equipment, (603) 881-2296 

Gindy Wild, FCMC (US), (508) 359-5482 

John O'Connell, FCMC ple, 44 (71) 262-1021 

Ron McClure, Pier-Luigi Zappacosta, Logitech, (415) 795-8500 

Tony Kobine, Systems in Concert, (415) 399-9411 

Tom Furness, William Bricken, Bob Jacobson, Human Interface Technology 
Laboratory, (206) 543-5075 

Jaron Lanier, Jean-Jacques Grimaud, VPL Research, (415) 306-1150 


COMING SOON 


Network navigation. 

Machine-assisted translation. 
Groupware tool survey. 

Application servers. 

And much more... (If you know of any 
good examples of the categories listed 
above, please let us know.) 
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relEAST: UNIX in the Soviet Union. 
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October 20-21 CPSR annual meeting - Palo Alto. Sponsored by Computer Pro- 
fessionals for Social Resposibility. Speakers include Jim 
Fallows of the Atlantic. Call Gary Chapman, (415) 322-3778. 

October 21-23 The Classic - Monterey, CA. Sponsored by the American Elec- 
tronics Association. Call Flo Lewis, (408) 987-4200. 

October 21-24 **EDventure East-West High-Tech Forum - Budapest, Hungary. 

Explore the problems and opportunities of high-tech business 
in Eastern Europe and meet your peers in a limited-attendance 
conference focused on contacts, not speeches. Sponsored by 
EDventure Holdings, with speakers and attendees from both 
sides. Call Daphne Kis, (212) 758-3434. By invitation only. 

October 21-25 OOPSLA/ECOOP 90 - Ottawa, Canada. Joint conference on 
object-oriented programming: Systems, languages and applica- 
tions. Keynote by Terry Winograd. Sponsored by ACM. Call 
David Thomas, (613) 228-3535. 

October 22-24 The fourth annual Computer Intelligence client forum - San 
Diego. "How to use market research and lists for sales pro- 
ductivity." Sponsored by Computer Intelligence. Keynote: 
Ken Wasch of SPA. Call Mike Hagan, (619) 450-1667. 

October 22-24 Electronic Messaging ‘90 - San Francisco. "Beyond inter- 
personal communication." Sponsor: Electronic Mail Associa- 
tion. With Helene Runtagh, GEISCO; Mike Zisman, Soft:Switch; 
others. Call Anne Spence, (703) 522-7111 or send e-mail via 
AT&T Mail: lema; CompuServe: 70007,2377; Dialcom: 63:PRDOO3; 
SprintMail: EMA; EasyLink: 62886257; iNet: ema.association; 
GEnie: EMA; Envoy 100: EMA; MCI Mail: EMA/2544290. (Do all 
these numbers make you long for fax?) 

October 23 Sixth annual Eiffel user conference - Ottawa, Ontario. 
Sponsored by Interactive Software Engineering. Call Darcy 
Harrison, (805) 685-1006. 


October 24 Stewart Alsop at the Boston Computer Society - Boston. Open 
letters to those who need them. Call (617) 367-8080. 
October 24 Emerging public companies - Santa Clara. Sponsor: American 


Electronics Association. Call Flo Lewis, (408) 987-4200. 
October 29-31 Hammer Forum & Clinic 90 - Cambridge. "Reengineering the 


corporation: Implementing major change." Sponsored by Hammer 
& Co. Gall Paula Kelley, (617) 354-5555. 
Oct 29-Nov 1 Electronic Imaging 90 - Boston. Sponsored by Advanced Imag- 


ing and Computer Graphics World. Call Carolyn Rosenbaum, 
(617) 232-3976. 

Oct 29-Nov 2 First annual meeting of the Soviet UNIX users’ group - Mos- 
cow. Sponsored by SUUG. Several hundred attendees are ex- 
pected, including Bill Joy; representatives of the European 
UNIX Users’ Group and usenix have been invited. Call Dmitri 
Volodin, 7 (095) 231-21-29, or V. Leonas, 7 (095) 120-69-21, 
or Esther Dyson, 1 (212) 758-3434. 

Oct 29-Nov 2 AutoCAD Expo - Moscow. Sponsored by Autodesk and Parallel. 
Call Semyon Becker, 7 (095) 287-49-15 or 946-28-37, or Alison 
Fenwick, 44 (483) 303322. . 

October 30 Intellectual property in computing - Cambridge, MA. Spon- 
sors: MIT and Boston Computer Society. "(How) should soft- 
ware be protected?" With Frank Ingari & Tom Lemberg, Lotus; 
Mitch Kapor; John Warnock; John Landry, Agility; Randy Davis, Nod 
MIT. Call Michael Ernst, (617) 258-8682. 
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October 30 


Oct 31-Nov 2 


Oct 31-Nov 2 


Oct 31-Nov 2 


November 


November 


November 


November 


November 


November 


November 


November 


November 


November 


November 


November 


November 


November 


4-7 


5-9 


6-7 


6-9 


12-16 


12-16 


13-14 


14-16 


15-16 


16-18 


26-29 


27-28 


28-29 


28-29 


Release 1.0 


Electronics and information technology industries - New York 
City. "A look at 1991 and beyond." Sponsor: Ernst & Young. 
Call Cynthia Corogin Rowe, (516) 231-0378 or (203) 978-1081. 
*UNTZ Expo - New York City. Sponsored by National Exposi- 
tions. Contact: Don Berey, (212) 391-9111. 

MacroMind developers’ conference - San Francisco. Call Scott 
Walchek or Amy Shelton, (415) 442-0200. 

UNICOM '90 - Washington, DC. Sponsored by North American 
Telecommunications Ass’n. Call Susan Ryba, (202) 296-9800. 
*ADAPSO management conference - Phoenix. Speakers include 
Steve Forbes Jr. and William Davidow of Mohr, Davidow Ven- 
tures. Contact: Ellen Kokolakis, (703) 522-5055 

ICCC 90 - New Delhi, India. Hosts: Government of India De- 
partments of Electronics and Telecommunications. Sponsored 
by The International Council for Computer Communication. 

Call P. Gupta, 91 (11) 683-0087, or fax, 91 (11) 684-4652. 
1990 ACM conference on critical issues - Arlington, VA. 
Sponsored by the Association for Computing Machinery. "Man- 
aging complexity and modeling reality." With Jay Forrester, 
David Parnas. Call Jim Adams, (212) 869-7440, 

Software Development Conference - Boston. Sponsor: Miller 
Freeman Publications. Topics include logic processing with 
decision tables by Jim McCarthy; heresies of software design 
with P.J. Plauger. Call KoAnn Tingley, (415) 995-2472. 
*Comdex Classic - Las Vegas. The real thing. Sponsored by 
Interface Group. Call Elizabeth Moody at (617) 449-6600. 
Neuro-Nimes '90 - Nimes, France. Neural networks and their 
applications. Sponsor: Association for Cognitive Research. 
Contact: Annick Crozet, (331) 47806452 or (331) 47807000. 
Outsourcing systems operations: revolution in information 
systems management - Vienna, VA. Sponsored by INPUT. Call 
Richard Perrotti, (703) 847-6872. 

Pacific Rim international conference on artificial intelli- 
gence '90 - Nagoya, Japan. Sponsored by the Japanese Society 
for Artificial Intelligence. Special sessions for AI in 
engineering and AI and large-scale information. Call Shigero 
Sato at (813) 479-5535 or fax (813) 479-7433. 

International protection of intellectual property: current 
issues and directions - San Francisco. Sponsored by Prentice 
Hall Law & Business. Call Robin Canetti, (201) 894-8260. 
*Hackers conference - Lake Tahoe. Sponsored by the Point 
Foundation, which also brought you the WELL, with assistance 
from may others. Call Glenn Tenney, (415) 574-0546. 
Conference on software maintenance - San Diego. "The inter- 
face between the development and the maintenance processes." 
Sponsored by IEEE. Call Michelle Carbone, (202) 371-1013. 
The 1990 Forrester Fortune 1,000 technology forum - Cam- 
bridge, MA. Client/server computing: the impact. Sponsored 
by Forrester Research. All-star line-up includes Jim Manzi, 
Scott McNealy, Jim Cannavino, Andy Grove, Charles Exley, Jim 
Treybig, Mike Hallman. Call Jean Baranowski, (617) 497-7090. 
Microsoft multimedia developers conference - San Jose. Call 
Brenda Hansen, (206) 882-8080 or (800) 628-11701. 

Salomon Brothers first annual technology conference - New 
York City. "The dawn of the networked computing era." Spon- 
sor: Salomon Brothers. Call Pamela Shore, (212) 747-6090. 
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December 3-4 


December 3-5 


December 3-7 


December 5-8 


December 10-11 


January 10-13 

January 21-24 

January 28-31 

February 12-15 
Feb 23-March 1 
February 24-28 
March 3-7 


March 10-13 


March 12-15 
March 13-20 
March 17-20 


March 23-25 


March 26-28 


April 8-12 
April 21-24 


May 20-23 


Release 1.0 


“Emerging technologies conference - Innisbrook, FL. For de- 
velopers eager to use the latest in technology -- object- 
oriented programming, cooperative processing, IBM repository, 
notepad computing, image management, etc. Sponsored by 
ADAPSO. Call Phyllis Cockerham, (703) 522-5055. 

European Publishing conference - The Hague, Holland. Spon- 
sored by Seybold Limited. Contact: Laurel Brunner, 44 (323) 
410561, or fax, 44 (323) 410279. 

Toulouse '90 - Toulouse, France. Software engineering and 
its applic ations. Sponsored by EC2. Contact: Jean-Claude 
Rault, (331) 47807000 or fax (331) 47806629. 

CASE °90 - Irvine, CA. The fourth international workshop on 
computer-aided software engineering. Sponsored by Index, 
IEEE, others. Call Ron Norman, (619) 594-3734. 

Virtual reality: theory, practice and promise - San Fran- 
cisco. Sponsored by Multimedia Review. Call Marilyn Reed, 
(800) 635-5537 or (203) 226-6967. 


1991 


Winter Consumer Electronics Show - Las Vegas. Sponsor: Elec- 
tronic Industries Ass'n. Call Cynthia Upson, (202) 457-4919. 
UniForum "91 - Dallas. Sponsored by UniForum Association. 
Call Ed Palmer, (408) 986-8840. 

*Network Computing Forum - Washington, DC. Sponsored by 
World Expo Corp. Call Christine Krajewski, (508) 820-8126. 
*Software Development '91 - Santa Clara. Sponsored by Miller 
Freeman. Call Lynne Mariani or Angela Hoyte, (415) 995-2471. 
Graphicon "91 - Moscow, USSR. Sponsor: USSR Academy of Sci- 
ences, with SIGGRAPH. Gall Kathleen Nilles, (312) 644-6610. 
IEEE conference on artificial intelligence applications - 
Miami Beach, FL. Call Anne Marie Kelly, (202) 371-0101. 
*Seybold Seminars °91 - Boston. Electronic publishing's 
premier conference. Call Kevin Howard, (213) 457-5850. 
*kEDventure Holdings PC (Platforms for Computing) Forum - 
Tucson, AZ. "Beyond the desktop: Networks, notepads and 
legacies." See page 27. Call Daphne Kis, (212) 758-3434. 
OpCon West - Palo Alto, CA. Sponsored by Soft*Letter. Call 
Tom Stitt, (617) 924-3944, 

Hannover Fair CeBIT ‘91 - Hannover, West Germany. Sponsor: 
Hannover Fairs USA. Call Donna P. Hyland, (609) 987-1202. 
*Software Publishers Association spring symposium - San Fran- 
cisco. Call Ken Wasch, (202) 452-1620. 

World computer law conference - Chicago. Co-sponsored by 
Center for Computer Law and Center for Informatics Law, John 
Marshall Law School. Call Michael Scott, (213) 689-5186. 
Spring symposium series - Stanford University. Sponsored by 
The American Association for Artificial Intelligence. Gall 
Carol Hamilton, (415) 328-3123. 

COMTEK °91 - Moscow. Sponsored by ComputerLand/Moscow. Call 
Stephen Woods, (203) 834-1122. 

*ADAPSO spring management conference - Miami. Call Ellen 
Kokolakis, (703) 522-5055. 

Spring Comdex ~ Atlanta, GA. Sponsored by The Interface 
Group. Call Elizabeth Moody, (617) 449-6600. 


8 October 1990 


27 


June 1-4 Consumer electronics show - Chicago. Sponsor: Electronic 


Industries Association. Call Cynthia Upson, (202) 457-4919. 
June 3-7 *Object World - San Francisco. Co-sponsored by IDG and Ob- 


ject Management Group. Businesspeople’s answer to OOPSLA. 
Gall Chris Stone, (508) 820-4300. 

June 9-12 *Expert Communications ‘91 - San Francisco. Sponsored by 
Graphics Communications Association and Davis Review. Call 

Mills Davis, (202) 667-6400, or Patty Hill, (703) 841-8160. 

July 14-19 AAAI conference - Anaheim. Sponsored by the American Associ- 
ation for Artificial Intelligence. Also includes Innovative 
Applications of AI. Call Carol Hamilton, (415) 328-3123. 

September 11-14 *Software Publishers Association annual conference - Orlando. 
Call Ken Wasch, (202) 452-1620. 


Please let us know about any other events we should include. -- Denise DuBois 


*The asterisks indicate events we plan to attend. Lack of an asterisk is no 
indication of lack of merit. 


PLATFORMS FOR COMPUTING FORUM | 


We have begun early planning for the Fourteenth Annual PC (Platforms 
for Computing) Forum, which we will hold in Tucson from March 10 to 13 
next spring -- two months later (and warmer!) than last year. The 
theme will be "Beyond the desktop: Networks, notepads and legacies." 
We will send further details and registration materials to subscribers 
shortly after Comdex (two paid attendees per subscription). 


Topics will include: tools for groupware, E-mail-based, network and 
database applications; new object-oriented databases (see last issue) 
and operating environments such as GO’s and Patriot Partners’; visual- 
ization of qualitative data such as text, priorities, workflows, data 
structures and program sequences (see this issue); natural language and 
other text-based applications; virtual reality; as well as more down- 
to-earth concerns such as operating system wars, distribution channel 
trends, customer attitudes, the changing marketplace -- and the ability 
to make use of "legacy" applications and data. Many of these technol- 
ogies will be illustrated by demos from start-up companies and a few 
larger outfits dabbling at the leading edge. 
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SUBSCRIPTION FORM 


Please enter my subscription to Release 1.0 at the rate of $495 per year 
in the U.S. and Canada. Overseas subscriptions are $575, airmail 
postage included. Payment in U.S. dollars must be enclosed. Multiple- 
copy rates on request. Satisfaction guaranteed or your money back. 


Name 


Title 


Company 


Address 


Cily State ____Zip 


Telephone 


How did you hear about Release 1.0? 


Please fill in the information above 

and send with your check payable to: 
EDVENTURE HOLDINGS INC. 
375 PARK AVENUE. SUITE 2503 
NEW YORK, NY 10152 


If you have any questions, please call us at (212) 758-3434. 


Daphne Kis 
Associate Publisher 
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